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(54) Display controller for three dimensional display 



(57) A display controller is provided for supplying 
serial pixel data to a scanned display, for instance of the 
flat panel LCD type for use in an autostereoscopic 3D 
display. The display controller comprises memories 22, 
23 associated with a memory controller 24 which con- 
trols reading from and writing to the memories 22, 23. 



In particular, during reading, the memory controller 24 
causes the memories 22, 23 to be read in turn so that 
image data for consecutively scanned pixels of the dis- 
play are read from different memories 22, 23. During 
writing to the memory, the memory controller 24 causes 
pixel data for each different view of a 3D image to be 
written in a respective one of the memories 22, 23. 
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Description 

[0001] The present invention relates to a display controller and to a three dimensional (3D) display including such a 
controller. The present invention also relates to a method ol reducing crosstalk, for instance between different views 
5 in a 3D display. 

[0002] Figure 1 of the accompanying drawings illustrates the layout of picture elements (pixels) of a standard type 
of liquid crystal device (LCD). The LCD is for use in a colour display and comprises red, green and blue pixels indicated 
by R, G and B. The pixels are arranged as columns Col 0 to Col 5 with the red, green and blue pixels being aligned 
vertically. Thus, the left-most column of pixels Col 0 displays the left-most strip of an image to be displayed, the adjacent 

10 column Col 1 lo the right displays the next column of the image and so on. 

[0003] As illustrated in Figure 2a of the accompanying drawings, such an LCD may be used to form a 3D autoster- 
eoscopic display. The 3D display comprises an LCD 1 which acts as a spatial light modulator (SLM) for modulating 
light from a backlight 2. A parallax optic cooperates with the LCD 1 in order to form viewing windows. Figure 2a illustrates 
a 3D autostereoscopic display of the front parallax barrier type in which the parallax optic comprises a parallax barrier 

is 3. The parallax barrier 3 comprises a plurality of parallel vertically extending laterally evenly spaced slits such as 4, 
each of which is aligned with the middle of a pair of individual colour pixel columns. For instance, the slit indicated at 
4 in Figure 2a is aligned with a column 5 of blue pixels and a column 6 of green pixels. 

[0004] Figure 2b illustrates the viewing window structure for a two view autostereoscopic 3D display of the type 
shown in Figure 2a. By spatially multiplexing two views forming a stereoscopic pair across the LCD 1 , the left and right 
20 views are visible in viewing windows 7 such that, provided an observer is disposed such that the left eye is in a left 
viewing window L and the right eye is in a right viewing window R : a 3D image can be perceived. Such positions are 
referred to as orthoscopic positions and are illustrated at 8, 9 and 10 in Figure 2b. 

[0005] Figure 2b also illustrates pseudoscopic viewing positions 11 to 14. When the observer is in one of these 
positions, the left eye views the right eye image whereas the right eye views the left eye image. Such viewing positions 
25 should be avoided. 

[0006] In order to ensure that the left and right viewing windows occur in the correct locations, left and right image 
data are supplied to an LCD of the type shown in Figure 1 in the way illustrated in Figure 3. The colour image data for 
the left-most strip of the left image are displayed by the red, green and blue pixels columns indicated at Col 0 Left. 
Similarly, the colour data for the left-most strip of the right eye view are displayed by the columns of pixels indicated 

30 at Col 0 Right This arrangement ensures that the image data for the left and right views are sent to the appropriate * 
left and right viewing windows This arrangement also ensures that all three pixel colours R, G and B are used to display 
each view strip. Thus, as compared with the layout shown out in Figure 1, the red and blue pixels of the left-most 
column display image data of the left view whereas the green pixels of the left-most column display image data of the 
right view. In the next column, the red and blue pixels display image data of the right view whereas the green pixels 

35 display image data of the left view. Thus, when using a standard LCD 1 of the type illustrated in Figures 1 to 3, interlacing 
of left and right view image data with "swapping" of the green components between columns of RGB pixels is necessary 
Of course, depending upon the display set-up, the red or blue components rather than the green components may be 
swapped. 

[0007] A standard PC (computer) is not capable of performing such interlacing and green (or red or blue) component 
40 swapping at standard video frame rate because every pixel "write" operation has to be modified compared with dis- 
playing a two dimensional (2D) image in the standard layout illustrated in Figure 1 . 

[0008] Autostereoscopic 3D displays using flat panel LCDs are disclosed in British patent application numbers 
9619097.0 and 9702259.4, European patent publication numbers 724175, 696144, 645926, 389842, and US patent 
numbers 5,553,203 and 5,264,946. 

4S [0009] Figure 4a of the accompanying drawings illustrates part of a known type of video board for use in computers. 
Examples of such video boards are disclosed in ARM VIDC20 Datasheet, Advanced Rise Machines Limited, February 
1995, Fuchs et al, "Pixel planes: a VLSI-oriented design for a raster graphic engine", VLSI Design, third quarter 1981, 
pp 20-28, and Harrel et al, "Graphic rendering architecture for a high performance desktop work station", Proceedings 
of ACM Siggraph conference, 1993, pp 93-100. The general layout of such an arrangement is illustrated in Figure 4a 

so of the accompanying drawings. Data to be displayed are supplied in serial form on a data bus 20 and addresses defining 
screen locations for the pixels are supplied'on an address bus 21 . The data bus 20 is connected to the inputs of several 
banks of random access memories (two shown in the drawing) such as VRAMs 22 and 23. The address bus 21 is 
connected to a memory management system 24 which converts the screen addresses into memory addresses which 
are supplied to the address inputs of the memories 22 and 23. 

ss [001 0] Output ports of the memories 22 and 23 are connected via a latch circuit 30 to a first in first out (Fl FO) register 
25 of a video controller 26, which additionally comprises circuit 27 for supplying red (R), green (G), blue (B), horizontal 
synchronisation (H) and vertical synchronisation (V) signals to a display device. The memories 22 and 23 and the 
register 25 are controlled so that individual pixel data are read alternately from the memories 22 and 23 and supplied . 
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in the correct order to the circuit 27. The circuit 27 : for instance, serialises the data and contains a colour pallet look 
up table (LUT) and digital-analogue converters (DAC). Timing signals for the video board are generated by a timing 
generator 28. 

[0011] Figure 4b illustrates the latch circuit 30 in more detail. The latch circuit 30 comprises latches 40 and 41 con- 
5 nected to the output ports of the memories 22 and 23 : respectively. Each of the latches 40 and 41 comprises 32 one 
bit latches arranged as groups of eight for latching R, G, B and A data from the respective memory. The eight bits A 
are described hereinafter. The latches 40 and 41 have latch enable inputs connected together and to an output of the 
timing generator 28 supplying latch enable signals L 

[0012] The latch circuit 30 further comprises three switching circuits 42, 43 and 44, each of which comprises eight 
10 individual switching elements whose control inputs are connected together. The control inputs of the switching circuits 

42, 43 and 44 are connected together and to an output of the timing generator 28 supplying a switching signal SW. 

The timing generator 28 has a further output supplying write enable signals F to the register 25. 

[0013] Figure 4c is a timing diagram illustrating the signals L, SW and F. These signals are synchronised by the 

timing generator 28 to the rest of the video board. 
is [0014] When new display data are available at the output ports of the memories 22 and 23, the latch enable signal 

L goes high, for instance as illustrated at time tl. The latches 40 and 41 thus latch the display data. Shortly after the 

latch enable signal L has returned to zero, the switching signal SW rises to a high level. At time t2 the switching circuits 

42, 43 and 44 are switched to the state illustrated in Figure 4b such that the RGB outputs of the latch 40 are connected 

to the register 25. At time t3 a write enable signal f is supplied to the register 25 so that the RGB data from the latch 
20 40 are written into the register 25. At time t4, the write enable signal F is disabled so as to prevent further data from 

being written into the register 25 until the next write enable signal. 

[0015] At time t5, the switching signal SW goes to the low level so that the switching circuits 42, 43 and 44 connect 
the outputs of the latch 41 to the register 25. A further write enable signal F occurs between times t6 and t7 so that the 
data from the latch 41 are written into the register 25. 
25 [0016] The next latch enable signal L occurs at time t8 and the process repeated. Thus, data are written into the 
register 25 alternately from the registers 22 and 23. 

[0017] The display device is notionally or physically divided into pixels and is of the scanned type. Image data for 
adjacent pixels are supplied consecutively to the display device and likewise lines of image data are supplied consec- 
utively. The data rate required by the display device therefore depends on the frame or field rate, the number of display 

30 lines per frame or field, and the number of pixels per line. Standard video rates are typically 50 interlaced fields per 
second but can exceed this and may, for instance, be of the order of 70 or 100 interlaced fields or non-interlaced frames 
per second. Each frame typically comprises 600 lines and there are typically 800 pixels per line. Each colour component 
is typically encoded by 8 bits. Accordingly, the input serial data rate required by display devices can exceed the max- 
imum output rate of available memory devices. 

35 [0018] The arrangement shown in Figure 4a allows increased data rates to be achieved by using multiple memories. 
With the two memories 22 and 23 illustrated, the maximum data rate for supplying image data to the display device is 
substantially equal to twice the rate at which each of the memories 22 and 23 can be read. Where two memories or 
two banks of memories are provided and pixel data are read alternately from the memories or memory banks, the 
image data are stored in the memories 22 or 23 as illustrated in Figure 5 of the accompanying drawings. In particular, 

40 image data for the even pixel columns are stored in the memory 22 whereas image data for the odd pixel columns are 
stored in the memory 23. 

[0019] It is also known to provide multiple video memories which are read simultaneously so as to increase the 
capacity or effective data rate for display devices. Examples of these techniques are disclosed Pinkham et al, "Video 
RAM Excels at Fast Graphics", Electronic Design, August 18, 1983, pp 160-172 and Whitton.. "Memory designed for 

45 raster graphics displays com", IEEE Computer Graphics and Applications March, 1984, pp 48-65. 

[0020] A known type of video board memory system for stereoscopic displays is disclosed in Silicon Graphic Inc., " 
Reality engine in visual simulation: technical overview", 1992. In this arrangement, memory is interleaved among par- 
allel graphics processors and the processors are arranged such that they always process adjacent pixels. Stereoscopic 
images are supplied time sequentially to the display such that left and right eye views occupy alternate fields of each 

50 video frame. 

[0021] U.S. 5553203 discloses a technique for producing spatially multiplexed images using five memory arrays. 
Two of the memory arrays are used for left and right eye image data. Another two of the arrays are used for copying 
the initial images processed by a spatial modulation function. The fifth memory array holds the spatially multiplexed 
image. Such an arrangement requires extra memory compared with a standard "frame-buffer" arrangement and so is 
55 substantially more expensive and has increased electrical power requirements. 

[0022] JP8-1 46454 discloses a 3D display having a memory arrangement with allows left and right eye images to 

be preserved separately and rewritten at any time. A separate memory bank is used for each image. 

[0023] According to a first aspect of the invention, there is provided a stereoscopic display controller for supplying 
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serial picture element data to a scanned stereoscopic display, where each picture element comprises image data for 
M colour components, where M is greater than one, the display controller comprising: 

N memories, where N is an integer greater than one; 

a memory controller arranged to write picture element data for N different views of a three dimensional image in 
respective ones of the memories, and arranged to control reading of the memories in turn so that image data for 
consecutively scanned picture elements of the display are read from different ones of the memories; and 
a data reordering circuit coupled to outputs of said memories and arranged to reorder image data for at least one 
of said colour components. 



[0024] N may be eq ual to two. Each picture element of image data may comprise image data for M colour components, 
where M is greater than one, and the display controller may comprise a data reordering circuit for simultaneously 
supplying image data of at least one first colour component and image data of at least one second colour component 
different from the first colour component for consecutively scanned picture elements of the display M may be equal to 
15 three. The at least one first colour component may comprise red and blue colour components and the at least one 
second colour component may comprise a green colour component. 

[0025] The display controller may be arranged such that each picture element written to a memory is a multi-bit word 
comprising a portion for erich colour component. Alternatively, each said picture element written to a memory may be 
a codeword, the display controller comprising a codeword converter coupled between the data reordering circuit and 
20 said memory outputs for converting codewords into respective multi-bit words each comprising a portion for each colour 
component. 

[0026] The data reordering circuit of the display controller may be arranged to interchange picture elements read 
fronrdifferent memories for said at least one colour component. Alternatively, the data reordering circuit may be ar- 
ranged to delay picture elements read from each of said memories for said at least one colour component by one 
25 picture element. 

[0027] The memory controller may be arranged to replicate picture element data for a two dimensional image in 
corresponding memory locations of the memories. 

[0028] Each of the memories may comprise at least one memory device. 

[0029] The display controller may comprise a latch for receiving output data from the memories. 

30 [0030] The display controller may comprise a first in first out circuit for receiving output data from the memories. 

[0031] According to a second aspect of the invention, there is provided a three dimensional display comprising a 
display controller according to the first aspect of the invention, a scanned stereoscopic display having a plurality of 
columns of picture elements, and a parallax optic having a plurality of parallax elements, each of which is associated 
with N adjacent columns of the picture elements. 

35 [0032] According to a third aspect of the present invention, there is provided a methodof supplying serial picture 
element data corresponding to N different views of a three dimensional image, to a scanned stereoscopic display, the 
method comprising delaying picture elements associated with a first colour component by one picture element relative 
to picture elements of the other colour component(s). 

[0033] Preferably, picture element data for said N views is written to respective ones of N different memories, and 

40 consecutively scanned picture elements are read from each of said memories. Thereafter said step of delaying picture 
elements associated with a first colour component for each read picture element stream is carried out. 
[0034] According to a fourth aspect of the present invention, there is provided a stereoscopic display controller for 
supplying serial picture element data corresponding to N different views of a three dimensional image, to a scanned 
stereoscopic display, the controller being arranged to delay picture elements associated with a first colour component 

45 by one picture element relative to picture elements of the other colour component(s). 

[0035] According to a fifth aspect of the present invention, there is provided a three dimensional display comprising 
a display controller according to the above fourth aspect of the present invention, a scanned stereoscopic display 
having a plurality columns of picture elements, and a parallax optic having a plurality of parallax elements, each of 
which is associated with N adjacent columns of the picture elements. 

so [0036] A problem which can adversely affect stereoscopic displays is crosstalk. Crosstalk is generated by stray light 
leaking between two "viewing channels". This results from several factors including scattering and diffraction by optical 
elements of display devices. The result is that the observer receives some of the left image with the right eye and vice 
versa. This appears as a low intensity image in the background and is often referred to as a ghost image. Crosstalk is 
undesirable as it is not a natural phenomenon and distracts the observer and causes visual stress. This problem is 

55 addressed in the article "Reducing Crosstalk Between Stereoscopic Displays", SPIE Vol.2177, pp. 92-95. 

[0037] According to a sixth aspect of the invention, there is provided a method of reducing crosstalk between first 
and second images defined by respective sets of picture elements, to produce respective sets of crosstalk corrected 
picture elements, the method comprising: 
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adding a grey level to the first image to form a first sum; 

adding said grey level to the second image to form a second sum; 

subtracting from the first sum an amount equal to a given fraction of said second image; and 
subtracting from the second sum an amount equal to the given fraction of said first image, 
5 wherein these steps comprise the calculation of a partial result which is used to determine crosstalk corrected 

picture elements for both the first and second images. 

[0038] Preferably, each picture element comprises M colour components having an intensity value, and the method 
further comprises, for an intensity level l x of each of the picture elements of said first image, determining a crosstalk 
io corrected picture intensity level l ox according to: 

L v = I + 



is 



20 



ox x d m + D 

or an equivalent lorm thereof and 

tor an intensity level l y of each of the picture elements of said second image, determining a crosstalk corrected 
picture intensity level t oy according to: 

, _, _ KCl m -l,-l v -1> 
oy y (L + D 



or an equivalent form thereof, 
25 where 

K is the scalar crosstalk correction; and 

l m is the scalar maximum value of each colour component. 

30 [0039] More preferably, the division operation in the preceding equation is implemented using a bit-shift operation. 
By restricting K to being a factor of 2, l oy may be easily computed using hardware components. 
[0040] Preferably, the partial result used to determine crosstalk corrected picture elements is: 



K(l -L-l -1). 

35 v m x y ' 

[0041] It is possible to provide a display controller by modifying standard video display systems by using interleaved 
memory banks in order to permit interlacing of columns or vertical strips of left and right colour stereoscopic image 
pixel data. Interlacing is performed as the image data for the individual pixels are written to the memories. Data output 
40 from the memories may be processed when necessary in order to perform swapping of colour components, for instance 
to achieve the correct left and right image interlacing for flat panel displays. 

[0042] The stereo image interlacing can be implemented in hardware with a simple addition to the widely used multi- 
bank video memory architecture. This has significant commercial advantages in requiring only small changes to existing 
video circuit designs in order to drive autostereoscopic displays. Further, it is not necessary to provide extra memory, 
45 for instance in image generating computers. This results in lower numbers of integrated circuits, smaller board sizes 
and reduced power consumption compared with known arrangements for generating and displaying 3D images. 
[0043] Interlacing of stereo images can be performed with minimal extra time penalties in software. Thus, no sub- 
stantial increase in processing time and memory capacity is needed. 

[0044] It is possible to display 2D images, 3D images or mixtures of the two simultaneously on the display. 
so [0045] It is also possible to provide a technique for reducing crosstalk between images by means of ah algorithm 
which requires little additional processing time. Thus, higher quality images can be produced with reduced visual stress 
to an observer and with no substantial increase in the number of integrated circuits and the power consumption. 
[0046] According to a seventh aspect of the present invention there is provided a stereoscopic display controller for 
supplying picture element data for N different views to a scanned stereoscopic display, the controller comprising: 

55 

a memory comprising a two-dimensional array of memory elements mapped to pixels of the stereoscopic display; 
a memory controller arranged to write picture element data for each said image into a contiguous block of memory 
elements and to read picture element data from the memory row by row; 
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at least one buffer for receiving at' least a part of each row as it is read from the. memory; 

a first data reordering circuit for reordering picture element data contained in the buffer, and any data read from 
the memory but not contained in the buffer, to provide a stream of picture element data in which the N views are 
interlaced; and 

a second data reordering circuit arranged to receive said data stream and to reorder picture element data for at 
least one of said colour components. 

[0047] Preferably, the memory controller is arranged to write picture element data for each image so that the data 
occupies a set of adjacent columns of memory elements. 

[0048] Preferably, the memory is provided by a single memory device. Alternatively however, the memory may be 
provided by a plurality of memory devices. 

[0049] In certain embodiments of the present invention said buffer is arranged to store the first half of a row of picture 
element data read from the memory. The first data reordering circuit is then arranged to interleave the buffered picture 
element data with the picture element data of the second half of the same row of picture elements as the second half 
of the row is read from the memory. 

[0050] In other embodiments of the invention, said buffer comprises first and second buffers each arranged to store 
a full row of memory elements. The memory controller is arranged to write rows of picture element data alternately into 
the first and second buffers, whilst said first data reordering circuit is arranged to interleave the picture element data 
in one of the first and second buffers whilst data is being read into the other. More preferably, each of the first and 
second buffers comprises a pair of half row buffers. 

[0051] The invention will be further described, by way of example with reference to the accompanying drawings, in 
which: 

Figure 1 is a diagram illustrating the pixel layout of a known type of LCD; 

Figure 2a is a diagrammatic lateral cross-sectional view of a known type of a 3D autostereoscopic display; 

Figure 2b is a diagrammatic plan view illustrating the formation of viewing windows by a display of the type shown 
in Figure 2a; 

Figure 3 is a view similar to Figure 1 illustrating the displaying of stereoscopic images; 

Figure 4a is a block schematic diagram of a known type of display memory controller; 

Figure 4b is a more detailed schematic diagram of part of the controller of Figure 4a; 

Figure 4c is a waveform diagram illustrating waveforms which occur in the controller of Figure 4a; 

Figure 5 illustrates the organisation of data in memories of the display controller of Figure 4a; 

Figure 6a is a bbck schematic diagram of a display controller constituting an embodiment of the invention; 

Figure 6b is a more detailed schematic diagram of part of the controller Figure 6a; 

Figure 6c is a waveform diagram illustrating waveforms which occur in the controller of Figure 6a; 

Figures 7 and 8 are views similar to Figure 5 illustrating different data organisations of the memories of the display 
controller of Figure 6a, 

Figure 9 is a diagram illustrating a typical display screen displaying a 3D image within a 2D image; 
Figure 10 illustrates how the screen image of Figure 10 is processed; 

Figure 11 is a diagram illustrating a possible arrangement of video pixel data supplied to the display controller of 
Figure 6a; 

Figure 12 is a block schematic diagram of a display controller constituting another embodiment of the invention; 
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Figure 13 illustrates schematically the various colour component depth planes produced with the embodiments of 
Figures 6, 12, and 13 

Figure 1 4 is a block schematic diagram of a display controller constituting yet another embodiment ot the invention; 

5 

Figure 15 illustrates a delay buffer of the controller of Figure 14; 

Figure 16 illustrates schematically the various colour component depth planes produced with the embodiment of 
Figure 14; 

10 

Figure 17 is a block schematic diagram of a display controller constituting another embodiment of the invention; 

Figure 18 is a diagram illustrating a method of reducing crosstalk between images constituting an embodiment of 
the invention. 

75 

Figure 1 9 is a block schematic diagram of a display controller constituting another embodiment of the invention; and 
Figure 20 is a block schematic diagram of a display controller constituting another embodiment of the invention; 

20 [0052] Like reference numerals refer to like parts throughout the drawings. 

[0053] The display controller shown in Figure 6a is for use with any type of scanned display, for instance of the LCD 
type shown in Figure 3. The display controller is of a type similar to that illustrated in Figure 4a and is shown as providing 
known row address select (RAS), column address select (CAS) signals to the address inputs of the memories 22 and 
23. The controller receives data in the form of RGB colour component signals and a "stereo" signal indicating whether 

25 the image to be displayed is in 2D or 3D. 

[0054] The video controller 26 differs from that shown in Figure 4a in that the output of the latch circuit 30 includes 
a green colour swap circuit 29 as shown in more detail in Figure 6b. The circuit 29 comprises an OR gate 45 having 
first and second inputs connected to receive the stereo-indicating bits S from the latches 40 and 41 . The output of the 
gate 45 is connected to a first input of an Exclusive-OR gate 46, whose second input is connected to receive switching 

30 signals SW from the timing generator 28. 

[0055] The control inputs of the switching circuits 42 and 44 are connected together and to the output of the timing 
generator 28 for receiving the switching signals SW in the same way as illustrated in Figure 4b. However, the switch 
controlling input of the switching circuit 43 is connected to the output of the gate 46 for receiving green switching signals 
SWG. 

35 [0056] Address signals supplied on the bus 21 to the memory management system 24 are converted into the row 
address select, column address select and row address signals needed to access the memories 22 and 23. When 
stereoscopic image data are present, the stereo-indicating bit is set so that the memory 22 stores left eye image data 
and the memory 23 stores right eye image data as illustrated in Figure 7. In the case of a 3D autostereoscopic display 
in which the parallax optic cannot be disabled, it is also possible to write 2D or monoscopic data which must be displayed 

40 to both eyes of the observer. In this case, when the stereo-indicating bit is not set, the monoscopic pixel data are 
duplicated in corresponding memory locations in the memories 22 and 23. In the 3D mode, each of the left and right 
eye images has half the horizontal spatial resolution of the display device. When operating in the 2D or monoscopic 
mode, the 2D image likewise has half the lateral resolution of the display device. 

[0057] When the stereo-indicating bits are not set ie. are at logic level zero, the output of the gate 45 is at logic level 
45 zero so that the gate 46 merely transmits the switching signals SW. The switching circuits 42 are therefore synchronised 
and operation is as described hereinbefore and as illustrated in Figure 4c. 

[0058] When the stereo-indicating bits S are set to logic level one, the output of the gate 45 is logic level one. The 
gate 46 therefore functions at a logic inverter so that the switching signal SW is inverted to form the green switching 
signal SWG as illustrated in Figure 6c. Thus, whenever the switching circuit 42 and 44 connect the red and blue inputs 
50 of the register 25 to the red and blue outputs of the latch 40, the switching circuits 43 connects the green input of the 
register 25 to the green input of the latch 41 , and vice versa. Thus, the left and green colour components are swapped 
between the pixel columns of adjacent pairs so that the autostereoscopic views are correctly displayed as described 
hereinbefore with reference to Figure 3. 

[0059] In an alternative arrangement (not shown), the parallax optic can be disabled either wholly or selectively in 
S5 regions where a 2D image is to be displayed. In this case, it is not necessary to duplicate pixel image data in the 
memories 22 and 23. Instead, the full spatial resolution of the display device or the relevant portion of the device may 
be used for displaying 2D images. 

[0060] The memory management system 24 controls reading of the memories 22 and 23 such that left and right eye 
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image pixel data are supplied at the correct times to the latch circuit 30. 

[0061] The arrangement of pixel data storage in the memories 22 and 23 shown in Figure 7 is appropriate for 3D 
autostereoscopic images which occupy the whole display. However, it is also possible to mix 2D and 3D images as 
illustrated in the storage arrangement of pixel data shown in Figure 8. In this case, a half width image must be drawn 

5 for each eye but the horizontal image origin for the full screen must also be divided by two for the image to be placed 
correctly on the half width screen. If the image is drawn as for the full width screen, all horizontal pixel coordinates may 
simply be divided by two. If the image is drawn at the necessary size, the origin of the stereo region must be known 
and is divided by two to locate the stereoscopic region correctly. Horizontal coordinates within the image must be 
unaffected because the image must remain the same size. 

10 [0062] To illustrate this, a specific example will be described in the case where the controller is used with a display 
whose screen size is 800x600 pixels. Such an arrangement may have three modes of operation, namely a 2D or 
monoscopic mode a full screen stereoscopic mode and a part screen stereoscopic mode. 

£0063] In the monoscopic mode, the full screen size is used conventionally so that images may be "drawn" in any 
area up to the lull 800x600 pixel area. 

15 [0064] In the lull screen stereoscopic mode, the controller is set to make one of the memories 22 and 23 (half the 
available screen memory) available for image display. The left image occupies one half (half the width of the screen) 
whereas the right image occupies the other half. When drawing a stereoscopic image, each of the two constituent 
images is hall the width of the full image ie. each of the left and right eye images occupies 400x600 pixels so that, 
when the images are interlaced, the full 800x600 pixel screen capacity is occupied. 

20 [0065] In the pari screen stereoscopic mode, one or more interlaced stereoscopic images is displayed on the screen 
and is surrounded by a monoscopic image as illustrated in Figure 9. The screen is referred to Cartesian coordinates 
such that the screen origin (0,0) is at the bottom left corner of the screen. Figure 9 illustrates a single interlaced ster- 
eoscopic image on part of the screen at 50. The horizontal and vertical dimensions of the stereoscopic image are given 
by S x S y whereas the image origin (bottom left corner) of the stereoscopic image has coordinates O x and O y relative 

25 to the screen 

[0066] The left and right images are drawn at half the final width of the interlaced stereoscopic image. Also, the 
horizontal coordinate of the image origin must be divided by two to fit into the "smaller screen space" available for each 
image as illustrated in Figure 10 

[0067] In the case where the bus 20 comprises a 32 bit parallel bus, each pixel video data may be of the form 
30 illustrated in Figure 11 The red (R), green (G) and blue (B) components each occupy 8 bits to leave 8 spare bits A. 
The 8 "spare" bits are usually unused but might, for example, hold alpha information or other control data. However, 
one of these bits is allocated to be the stereo-indicating bit. 

[0068] Figure 1 2 illustrates a display of the type shown in Figure 6a but modified to supply to the display the stereo- 
indicating bits from the pixel data on the bus 20. Such an arrangement may be used with a switchable 2D/3D display 

35 such that the display may be controlled on a pixel by pixel basis. 

[0069] The arrangement described above results, in one example, in the viewer perceiving red, green, and blue 
components of an image at the planes illustrated schematically in Figure 13. Notably, the red and blue components 
are observed at a plane lying behind the display plane, whilst the green component is observed at a plane lying in front 
of the display plane. This disparity between display planes may result in a slight deterioration in the displayed image. 

40 [0070] It is possible to solve this problem, whilst at the same time ensuring that the red, green, and blue colour 
components for the left and right images are displayed at the correct spatial locations relative to the viewer's eyes, by 
merely delaying the green colour components of both images by one pixel relative to the red and blue colour compo- 
nents. Of course, in other display configurations it may be the red or blue components which are delayed. 
[0071] There is illustrated in Figure 14, in block diagram form, a hardware arrangement for producing a one pixel 

45 delay in the green components of the left and right images. Those components common to the display controller of 
Figure 6a are identified with like numerals. The video controller of Figure 14 differs from that of Figure 6a in that the 
former does not have the green colour swap circuit 29. Rather, the output of the latch circuit 30 is provided directly to 
the FIFO register 25. Circuits 47 and 48, which receive the output from the FIFO, correspond to circuit 27 of Figure 6a 
except that the digital to analogue converter (DAC) function (optional in the embodiment of Figure 6a) is not present. 

so The output from circuit 48, in digital form, is provided to a green shift circuit 49 which may be for example a FIFO buffer. 
The circuit 49 introduces the required one pixel delay into the green component of both the left and right images, 
relative to the red and blue components. Assuming that the input to the display needs to be digital, the output from the 
circuit 49 is passed to a digital to analogue converter 50. The green shift circuit 49 is shown in more detail in Figure 
15. The final display may be improved by initialising the display buffer with a suitable colour level, e.g. black, at the 

55 start of each new row. This is preferable to using the last green component from the previous row. 

[0072] It will be appreciated that the controller of Figure 14 is much simplified.over that of Figure 6a, as the former 
does not require the more complex latch and swap circuit of the latter. It will also be appreciated that the delay to the 
green colour components may be introduced at any appropriate point in the controller, i.e. not necessarily immediately 
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before the digital to analogue converter 50. This technique is also not limited to use in video controllers having a memory 
associated with each separate image. 

[0073] Figure 16 illustrates the colour component depth planes which result from the display of Figure 14 for one 
specific example. It will be seen that all colour components, red, green, and blue, are displayed in the same plane 

5 immediately behind the display plane. This improved result generally holds true for all displayed stereoscopic images. 
[0074] There will now be described a further embodiment of the invention with reference to Figure 17. The display 
controller illustrated in Figure 17 differs from that shown in Figure 6a in that a crosstalk correction unit 31 is provided 
for reducing crosstalk between the left eye and right eye images of a 3D autostereoscopic display. The crosstalk cor- 
rection unit 31 is disposed between the memories 22 and 23 and the video controller 26. 

10 [0075] Although crosstalk reduction is desirable for all types of displays, effective crosstalk reduction can be readily 
provided in flat panel displays, where the crosstalk from one view is registered well with the pixels in the other view. 
[0076] The method of reducing crosstalk is based on adding a base level of grey to every pixel of both the left and 
right images so as to raise the background grey level. The amount of grey is preferably equal to or greater than the 
amount of crosstalk correction required. A percentage of the left image corresponding with the amount of crosstalk to 

is be corrected is then subtracted from the right image and vice versa. This results in a low intensity negative image in 
the background grey level. When the corrected images are displayed, the crosstalk fills in the negative images so that 
a uniform background grey level is restored. Thus, image contrast is sacrificed so as to improve crosstalk and hence 
improve the perceived 3D image quality 

[0077] The amount of crosstalk correction required may be determined by experimental measurement of a display 
20 The crosstalk correction factor may then be set in various ways, such as by an electronic bus connected to a central 
processing unit of the system, a data cable connected to a control knob ; or by putting the data into available ones of 
the spare bits A of the 32 bit pixel data. 

[0078] The method is described in more detail hereinafter for a pixel in the left image and its corresponding pixel in 
the right image, where: 

25 

f, - is - the incoming RGB colour vector for the left pixel; 
/ r - is - the incoming RGB colour vector for the right pixel; 
l b - is - the colour vector with raised background grey level; 
l Q - is - the output colour vector with crosstalk correction; 
30 C - is - the scalar crosstalk correction in the range [0.255]; and 

l m = 255 - is - the scalar maximum value of each RGB component. 

[0079] All of the individual values are integers in the range [0,255] assuming 8 bits per colour component in each 24 
bit full colour pixel. 

35 [0080] First, a background grey level is added to the left image pixel: 



40 



45 




(1) 



[0081] The corresponding right image pixel crosstalk correction is subtracted from the new value of the left image 
pixel: 

■.='b-',*f < 2 > 

m 

so [0082] The value \ Q is then output as the new left image pixel colour value. 

[0083] This method must be applied to every pixel in the left image to correct for right image crosstalk and to every 
pixel in the right image to correct for left image crosstalk. The method may be implemented in software and provides 
a good improvement in the image quality on flat panel displays. 

[0084] For a hardware implementation in conjunction with the image interlacing described hereinbefore, the method 
55 may be performed using only integer arithmetic. This significantly reduces the complexity of a hardware implementation 
by removing the need for a floating-point arithmetic unit. 

[0085] For binary computing devices the use of numbers that are a power of two has significant advantages. For this 
reason the input pixel colour values are raised by one from the range [0,255] to the range [1 ,256]. The above method 
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35 



40 



45 



50 



55 



can then be re-written as below where K is the scalar cross talk correction in the range [1 ,256]. 
[0086] From equations (1 ) and (2):- 

io multiplying out the above gives: 

0 O + 1 K'm + 1 > = <>1 +1 >( l m + 1 ) +K ('m + ^ ' K d + 1 > ' K < ! r + 1 > < 4 > 

75 rearranging this gives: 

Kfl-I.-I - 1) 



20 

[0087] This is computed efficiently using a bit shift operation instead of division since the value (/ m +1) = 256 and is 
accounted for with a bit-wise right shift by 8 bits. 

25 lo = l 1 +K (' n ,-'l-'r--')»8 (6) 

[0088] The output crosstalk corrected value for the right pixel is computed similarly: 

30 l o = l r + K ('m- | 1 ' K ^>> Q ( 7 ) 

[0089] This computation is illustrated in Figure 18, where the partial result K(l m - 1 1 - l r - 1 )»8 is computed at 32 and 
is added to the left and right pixel values //and / r at 33 and 34, respectively 

[0090] If the value of K is restricted to be a factor two, where K = 2 n , then the computation is more simply implemented 
since the multiplication by K can be incorporated into the right shift, resulting in a computation requiring only addition, 
subtraction and right shift operations, ie: 



, o = , i +d m -l 1 -l r -1)»(8-n) (8) 

[0091] Use of expression (6) or (8) has the advantage that all the arithmetic is integer with the largest resulting 
number requiring only an 18 bit signed value, thus greatly reducing the implementation complexity of the hardware. 
[0092] The crosstalk correction methods described hereinbefore assume that the display used has a perceived linear 
response to the input values, this is not normally the case and it is usually compensated for by using gamma correction 
in the video display driving circuit, for instance as disclosed in Glassner, "Principles of Digital Image Syntheses", Morgan 
Kaufman, 1995, Chapter 3, pp 97-100. With the above method, the gamma correction can be applied to every pixel 
after the crosstalk correction has been computed. Alternatively, it can be applied to the correction factor K alone before 
crosstalk correction is computed. 

[0093] Also, the above methods assume a 24 bit or similar full colour pixel value. This is not always the case and, 
in some systems, colour indexing is used to save memory. This is where there is a limited range of colour values and 
the actual value stored in video memory is an index into a look-up table, which holds the full 24 bit RGB values. Often, 
with this approach, only 8 bits are stored per pixel, resulting in 256 possible colours on the display at any one time. 
For colour indexing systems, the colour swapping and crosstalk correction should be performed after the colour index 
has been decoded into its 24 bit RGB display driving values. 

[0094] Figure 19 is a diagram illustrating a display controller having a single memory device 51 which comprises a 
2-D array of memory elements mapped to respective pixels of the LCD display The memory management system 24 
is arranged to write the 400x600 picture elements of the left image into the first block of 400 columns of the memory 
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device and the 400x600 picture elements of the right image into the second block of 400 columns. It will be appreciated 
that this allocation of memory is desirable from the point of view of efficiently writing data to the memory. 
[0095] The memory management system 24 causes picture element data to be read from the memory device 51 
row by row. The first half of each row, i.e. picture elements of the left image, is read into a half row buffer. The second 
5 half of the row. i.e. picture elements of the right image, is then read from the memory and the picture elements thereof 
interleaved with the buffered picture elements to produce the required right left alternation. The interleaved data stream 
is then provided to a video controller corresponding to that of the embodiment of Figure 14 (alternatively the controller 
of Figure 6a may be used). 

[0096] Figure 20 illustrates an alternative buffer arrangement to that described in Figure 1 9. The buffer arrangement 
10 comprises two pairs of half row buffers 52,53 which alternately receive picture element rows read from the memory 
device 51 . Thus a first row is read into a first of the buffer pairs 52 with the next row subsequently being read into the 
second of the buffer pairs 53. Within the first buffer pair 52, the picture elements of the left image are read into a first 
of the half row buffers 52a with the picture elements of the right image being read into the second of the half row buffers 
52b. Whilst the picture elements contained in the half row buffers 52a,52b are being interleaved and output to the video 
is controller 26, the next row of picture elements is being read into the second pair of half row buffers 53a,53b. Subse- 
quently, as the picture elements contained in the half row buffers 53a,53b are being interleaved and output, the next 
row of picture elements is being read into the half row buffers 52a,52b. 



20 Claims 



25 



35 



40 



1 . A stereoscopic display controller for supplying serial picture element data to a scanned stereoscopic display, where 
each picture element comprises image data for M colour components, where M is greater than one, the display 
controller comprising: 



N memories, where N is an integer greater than one; 

a memory controller arranged to write picture element data for N different views of a three dimensional image 
in respective ones of the memories, and arranged to control reading of the memories in turn so that image 
data for consecutively scanned picture elements of the display are read from different ones of the memories; 
30 and 

a data reordering circuit coupled to outputs of said memories and arranged to reorder image data for at least 
one of said colour components. 



2. A display controller as claimed in claim 1, in which N is equal to two. 

3. A display controller as claimed in claim 1 or 2, in which M is equal to three. 

4. A display controller as claimed in claim 3, in which said cobur components are red, green, and blue, and said at 
least one of colour component is green. 

5. A display controller according to any one of the preceding claims, in which each said picture element written to a 
memory is a multi-bit word comprising a portion for each colour component. 

6. A display controller according to any one of the preceding claims, in which each said picture element written to a 
45 memory is a codeword, and the display controller comprises a codeword converter coupled between the data 

reordering circuit and said memory outputs for converting codewords into respective multi-bit words each com- 
prising a portion for each colour component. 

7. A display controller according to any one of the preceding claims, in which the data reordering circuit is arranged 
50 to interchange picture elements read from different memories for said at least one colour component. 

8. A display controller according to any one of claims 1 to 6, in which the data reordering circuit is arranged to delay 
picture elements read from each of said memories for said at least one colour component by one picture element. 

ss 9. A display controller as claimed in any one of the preceding claims, in which the memory controller is arranged to 
replicate picture element data for a two dimensional image in corresponding memory locations of the memories. 

10. A display controller as claimed in any one of the preceding claims, in which each of the memories comprises at 
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least one memory device. 

11. A display controller as claimed in any one of the preceding claims, comprising a latch for receiving output data 
from the memories. 

5 

12. A display controller as claimed in any one of the preceding claims, comprising a first in first out circuit for receiving 
output data from the memories. 

13. A three dimensional display comprising a display controller as claimed in any one of the preceding claims, a 
io scanned stereoscopic display having a plurality columns of picture elements, and a parallax optic having a plurality 

of parallax elements, each of which is associated with N adjacent columns of the picture elements. 

1 4. A method of supplying serial picture element data corresponding to N different views of a three dimensional image, 
to a scanned stereoscopic display, the method comprising delaying picture elements associated with a first colour 

is component by one.picture element relative to picture elements of the other colour component(s). 

15. A method according to claim 14 and comprising writing picture element data for said N views to respective ones 
of N different memories, reading consecutively scanned picture elements from each of said memories, and there- 
after carrying out said step of delaying picture elements associated with a first colour component for each read 

20 picture element stream. 

16. A stereoscopic display controller for supplying serial picture element data corresponding to N different views of a 
three dimensional image, to a scanned stereoscopic display, the controller being arranged to delay picture elements 
associated with a first colour component by one picture element relative to picture elements of the other colour 

25 component (s). 

17. A three dimensional display comprising a display controller as claimed in claim 16, a scanned stereoscopic display 
having a plurality of columns of picture elements, and a parallax optic having a plurality of parallax elements, each 
of which is associated with N adjacent columns of the picture elements. 

30 

18. A method of reducing crosstalk between first and second images defined by respective sets of picture elements, 
to produce respective sets of crosstalk corrected picture elements, the method comprising: 

adding a grey level to the first image to form a first sum; 
adding said grey level to the second image to form a second sum; 

subtracting from the first sum an amount equal to a given fraction of said second image; and 
subtracting from the second sum an amount equal to the given fraction of said first image, 
wherein these steps comprise the calculation of a partial result which is used to determine crosstalk corrected 
picture elements for both the first and second images. 

A method according to claim 1 8, wherein each picture element comprises M colour components having an intensity 
value, the method comprising 

for an intensity level l x of each of the picture elements of said first image, determining a crosstalk corrected 
picture intensity level l ox according to: 

K(L -1-1-1) 
I = | + ?L^i Y. 



so or an equivalent form thereof and 

for an intensity level l y of each of the picture elements of said second image, determining a crosstalk corrected 
picture intensity level l oy according to: 

55 |=|+ - — - — * 

°y y ci m + D 

or an equivalent form thereof, 
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where 

K is the scalar crosstalk correction; and 
l m is the scalar maximum value of each colour component. 

A method according to claim 18 or 19, wherein said partial result is 

K(l m -I x -I y -1) 

10 

and 

K is the scalar crosstalk correction; 

l m is the scalar maximum value of each colour component 
75 i x are the picture elements of the first image; and 

l y are the picture elements of the second image. 

A method according to claim 20, wherein the division operations of claim 1 9 are carried out using a bit shift operation 
on the partial result. 

A stereoscopic display controller for supplying picture element data for N different views to a scanned stereoscopic 
display, the controller comprising: 

a memory comprising a two-dimensional array of memory elements mapped to pixels of the stereoscopic 
25 display: 

a memory controller arranged to write picture element data for each said image into a contiguous block of 
memory elements and to read picture element data from the memory row by row; 
at least one buffer for receiving at least a part of each row as it is read from the memory; 
a first data reordering circuit for reordering picture element data contained in the buffer, and any data read 
30 from the memory but not contained in the buffer, to provide a stream of picture element data in which the N 

views are interlaced; and 

a second data reordering circuit arranged to receive said data stream and to reorder picture element data for 
at least one of said colour components. 

35 23. A stereoscopic display controller according to claim 22, the memory controller being arranged to write picture 
element data for each image so that the data occupies a set of adjacent columns of memory elements. 

24. A stereoscopic display controller according to claim 22 or 23, the memory consisting of a single memory device. 

40 25. A stereoscopic display controller according to any one of claims 22 to 24, said buffer being arranged to store the 
first half of a row of picture element data read from the memory and the first data reordering circuit being arranged 
to interleave the buffered picture element data with the picture element data of the second half of the same row 
of as the as the second half of the row is read from the memory. 

45 26. A stereoscopic display controller according to any one of claims 22 to 24, said buffer comprising first and second 
buffers each arranged to store a full row of memory elements, the memory controller being arranged to write rows 
of picture element data alternately into the first and second buffers, and said first data reordering circuit being 
arranged to interleave the picture element data in one of the first and second buffers whilst data is being read into 
the other. 

50 

27. A stereoscopic display controller according to claim 26, each of said first and second buffers comprising a pair of 
half row buffers. 
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(57) A display controller is provided for supplying 
serial pixel data to a scanned display, for instance of the 
flat panel LCD type for use in an autostereoscopic 3D 
display. The display controller comprises memories 22, 
23 associated with a memory controller 24 which con- 
trols reading from and writing to the memories 22, 23. 



In particular, during reading, the memory controller 24 
causes the memories 22, 23 to be read in turn so that 
image data for consecutively scanned pixels of the dis- 
play are read from different memories 22, 23. During 
writing to the memory, the memory controller 24 causes 
pixel data for each different view of a 3D image to be 
written in a respective one of the memories 22, 23. 
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